A SRN/HMM System for Signer-Independent Continuous Sign Language Recognition
نویسندگان
چکیده
Sign language recognition is to provide an efficient and accurate mechanism to transcribe sign language into text or speech. State-of-the-art sign language recognition should be able to solve the signer-independent continuous problem for practical applications. A divide-and-conquer approach, which takes the problem of continuous Chinese Sign Language (CSL) recognition as subproblems of isolated CSL recognition, is presented for signerindependent continuous CSL recognition in this paper. In the proposed approach, the improved simple recurrent network (SRN) is used to segment the continuous CSL. The outputs of SRN are regarded as the states of hidden Markov models (HMM) in which the Lattice Viterbi algorithm is employed for searching the best word sequence. Experimental results show that SRN/HMM approach has better performance than the standard HMM.
منابع مشابه
A Chinese sign language recognition system based on SOFM/SRN/HMM
In sign language recognition (SLR), the major challenges now are developing methods that solve signer-independent continuous sign problems. In this paper, SOFM/HMM is first presented for modeling signer-independent isolated signs. The proposed method uses the self-organizing feature maps (SOFM) as different signers’ feature extractor for continuous hidden Markov models (HMM) so as to transform ...
متن کاملSigner-Independent Continuous Sign Language Recognition Based on SRN/HMM
A divide-and-conquer approach is presented for signer-independent continuous Chinese Sign Language(CSL) recognition in this paper. The problem of continuous CSL recognition is divided into the subproblems of isolated CSL recognition. We combine the simple recurrent network(SRN) with the hidden Markov models(HMM) in this approach. The improved SRN is introduced for segmentation of continuous CSL...
متن کاملMAN-MACHINE INTERACTION SYSTEM FOR SUBJECT INDEPENDENT SIGN LANGUAGE RECOGNITION USING FUZZY HIDDEN MARKOV MODEL
Sign language recognition has spawned more and more interest in human–computer interaction society. The major challenge that SLR recognition faces now is developing methods that will scale well with increasing vocabulary size with a limited set of training data for the signer independent application. The automatic SLR based on hidden Markov models (HMMs) is very sensitive to gesture's shape inf...
متن کاملTowards a Video Corpus for Signer-Independent Continuous Sign Language Recognition
Research in the field of continuous sign language recognition has not yet addressed the problem of interpersonal variance in signing. Applied to signerindependent tasks, current recognition systems show poor performance as their training bases upon corpora with an insufficient number of signers. In contrast to speech recognition, there is actually no benchmark which meets the requirements for s...
متن کاملA Novel Occlusion Sign Language Recognition
Sign language plays an important role in communicate with changers that hearing improved. However, the sign language in many countries and areas different and auto recognition system became the research way in recent year. In this paper, we devise a novel method for occlusion processing in Taiwan Sign Language recognition system. Our method employs adxl345 and Kinect to extract the feature of s...
متن کامل